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A SYSTEM FOR AND METHOD OF DISPLAYING INFORMATION 



The invention relates to a system for displaying information on a display 

device , comprising: 

- receiving means for receiving a transport stream comprising services, with 
the services having elementary streams of video and of data-elements; 

5 - user interface means for making a user selection of a type of information to 

be displayed on the display device; 

- a filter for selecting a first data-element of a first one of the services on basis 
of the user selection; 

- rendering means for calculating an output image to be displayed on the 
10 display device, on basis of the first data-element selected by the filter; and 

- switching means for switching from the first one of the services to a second 
one of the services. 

The invention further relates a method of displaying information on a display 
device comprising the steps of: 
15 - receiving a transport stream comprising services, with the services having 

elementary streams of video and of data-elements; 

- user actions of making a user selection of a type of information to be 
displayed on the display device; 

- filtering to select a first data-element of a first one of the services on basis of 
20 the user selection; 

- rendering to calculate an output image to be displayed on the display device, 
on basis of the first data-element selected by the filter; and 

- switching from the first one of the services to a second one of the services. 
An embodiment of the system of the kind described in the opening paragraph 

25 is known as set top box. A set top box is linked to a Digital Video Broadcast (DVB) server by 
means of a broadband network and optionally by means of a second network, primarily for 
data flow from the set top box. Typically the broadcast server and the set top box are in 
compliance with a standard, e.g. Multimedia Home Platform (MHP). The Broadcast server is 
responsible for generating a transport stream, e.g. an MPEG-2 transport stream comprising 
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video, audio and data. The data comprises application data, i.e. software code representing an 
application to be run on the set top box, and data to be processed by such an application. A 
set top box provides its output to a television. Optionally the set top box is integrated into the 
television. The set top box is arranged to receive the transport stream and to select one of the 
5 services. Typically a service comprises mutually related elementary streams of video, audio 
and data. E.g. a video stream of a service represents a sequence of images being captured of a 
football match. Optionally there is a further video stream which represents another sequence 
of images being captured of the football match from another point of view. An audio stream 
corresponds to the sound being captured in the stadium of this football match and another 

10 audio stream corresponds to the voice of a reporter. The data is also related to football. The 
data of the data stream might correspond to the actual situation of the match, e.g. the score, 
who made the goals and when, the number of yellow and red cards, the current players of the 
teams, etcetera. The data might also correspond to other aspects of football, e.g. the 
tournament schedule, statistical information on teams and players, etcetera. 

15 The set top box comprises means to select a service from the transport stream. 

The set top box further comprises user interface means for making a user selection of the type 
of information to be displayed on the television. Typically this works by means of a graphical 
user interface which is the visible part of an application. The user is provided with menus of 
options corresponding to information which is available in the elementary data stream of the 

20 selected service. By browsing through the menus and by selecting an option the user defines 
which type of data, i.e. which data-elements, should be selected from this elementary data 
stream which has been partly received and is partly to be received, by the set top box. A 
visual representation of the selected data-elements is then displayed on the television. E.g. 
"Team A-Team B : 0-2". The user can switch to another service for which he can also select 

25 information to be displayed, by means of browsing and selecting provided options. In the 
latter case the provided options relate to the most recently selected service. 

It is an object of the invention to provide a system of the kind described in the 
opening paragraph which is more user friendly. 

The object of the invention is achieved in that the system is designed to apply 

30 the filter for selecting a second data-element of the second one of the services, on basis of the 
user selection, when being switched from the first one of the services to the second one of the 
services, with the first data-element and the second data-element being mutually semantically 
related and to apply the rendering means for calculating the output image to be displayed on 
the display device, on basis of the second data-element selected by the filter. The user does 
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not have to make a new selection after being switched from the first service to the second 
service. That means that the user does not have to browse again through the menus in order to 
define which type of information he is interested in. The user selection being made on basis 
of the provided options while the first service was selected, is used to select the appropriate 
5 data-elements of the stream of the second service. The invention is based on the insight that 
different services often have the same information model, i.e. data model. That also means 
that various content providers share one information model or make use of similar 
information models. 

An embodiment of the system according to the invention is designed to apply 

10 the filter for selecting the second data-element, when being switched from the first one of the 
services to the second one of the services, with the data-element and the second data-element 
being mutually semantically equal. Preferably the data-element and the second data-element 
are also syntactically equal. The working of this embodiment will be explained by means of 
an example. Suppose that the user has selected the option "show actual score" while 

1 5 watching a football match being provided by means of the first service. The result is that 
data-elements which are classified with label "Score" are filtered from the incoming data- 
elements belonging to the first service. The current score of the football match, which is 
broadcast via the first service, is displayed on the display device. After being switched to a 
second service, corresponding to another football match, data-elements which are classified 

20 with label "Score" are filtered from the incoming data-elements belonging to the second 

service. Now the current score of the other football match, which is broadcast via the second 
service, is displayed on the display device. 

Another embodiment of the system according to the invention comprises a 
converter for controlling the filter to select the second data-element on basis of the user 

25 selection and a third data-element of the second one of the services. The working of this 

embodiment will be explained by means of an extension of the example above. Suppose that 
the user has selected the option "show actual score" while watching a football match being 
provided by means of the first service. The result is that data-elements which are classified 
with label "Score" are filtered from the incoming data-elements belonging to the first service. 

30 Now the user switches to the second service, which comprises streams of video, audio and 
data of a tennis game. In this latter data stream there are no data-elements with label "Score". 
However there are data-elements with label "tennis" and there are data-elements with labels 
"Scores". The converter is able to map "Score" to "Scores" on basis of a data-element with 
label "tennis". This embodiment of the system according to the invention is advantageous in 
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the case that different services do not have the same information model but that it is possible 
to map a data type of a first information model into a data type of a second information 
model. 

In an embodiment of the system according to the invention, the rendering 
5 means are arranged to calculate a mixed output image to be displayed on the display device, 
on basis of the selected data-element and a first image of a first elementary stream of video. 
Preferably the graphical representation of the data-element is displayed as an overlay on the 
input images of the video stream. 

An embodiment of the system according to the invention comprises storage 
10 means for storage of a parameter which determines the filter. The advantage of this 

embodiment is that the properties of the filter are made persistent. After a restart of the 
system or application the same filtering operation can be performed. 

An embodiment of the system according to the invention is arranged to run an 
application, which enables in making the user selection and of which software code is being 
1 5 exchanged by means of a first elementary stream of data-elements. By exchanging the 

software code via the transport stream, it is possible to have up-to-date software at the client 
side of the network, i.e. in the system, e.g. set top box. This is especially important in the 
case of modifications of an information model and for the converter. 

An embodiment of the system according to the invention comprises the 
20 display device. The system might comprise a separate set top box and television. But 
preferably these two are integrated into one unit. 

It is a further object of the invention to provide a method of the kind described 
in the opening paragraph which is more user friendly. 

This object of the invention is achieved in that the method of displaying 
25 information on a display device is characterized in comprising a second step of filtering to 
select a second data-element of the second one of the services, on basis of the user selection, 
when being switched from the first one of the services to the second one of the services, with 
the first data-element and the second data-element being mutually semantically related and a 
second step of rendering to calculate the output image to be displayed on the display device, 
30 on basis of the second data-element selected by the filter. 

Modifications of the system and variations thereof may correspond to modifications and 
variations thereof of the method described. 
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These and other aspects of the system and of the method according to the 
invention will become apparent from and will be elucidated with respect to the 
implementations and embodiments described hereinafter and with reference to the 
accompanying drawings, wherein: 

Fig. 1 schematically shows an embodiment of the system according to the 
invention in its context; and 

Fig. 2 schematically shows components of an embodiment of the system 

according to the invention. 

Corresponding reference numerals have same or like meaning in all of the Figures. 



Fig. 1 schematically shows an embodiment of the system 100 according to the 
invention in its context. The system 100 has a number of connections with other systems 102 
and 110: 

- The system 100 is connected to a broadcast server 1 10 by means of a 
broadband network 106. The broadcast server 1 10 is responsible for providing the transport 
streams to the broadband network 106. 

- The system 100 is connected to a television 102 which comprises a display 
device 104. Video and audio content and data being exchanged via the system 100 are 
displayed on the television 102. 

- The system 100 is optionally connected to a broadcast server 1 10 by means 
of a second network 108, e.g. Ethernet. This second network is primarily used for data 
exchange from the system 100 to e.g. the broadcast server 1 10. 

The broadcast server 1 10 comprises a first storage means 1 12 for storage of 
video and audio content being provided by means of input connector 120. The broadcast 
server 1 10 also comprises a second storage means 1 14 for storage of data. This data 
comprises application data, i.e. software code which is the base of an application to be run on 
the system 100, and of data to be processed by the application. The video and audio content 
are multiplexed with the data by means of multiplexer 116. The resulting transport stream is 
modulated by means of the modulator 1 18 which is designed to convert the transport stream 
to a higher frequency such that it can be transmitted on the broadband network 106 (e.g. 
terrestrial or satellite). 
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Fig. 2 schematically shows components 202-208, 222-224 and interfaces 212- 
216 of an embodiment of the system 100 according to the invention. The system 100 
comprises: 

- receiving means 202 for receiving transport streams being provided on the 
input connector 214. A transport stream comprises services. A service comprises elementary 
streams of video, audio and of data-elements; 

- user interface means 220 for making a user selection of a type of information 
to be displayed on the display device 104. Preferably the user interface means comprise a 
remote control unit 220. The signals sent by the remote control 220 are received via input 
sensor 212. Another part of the user interface means is the display device 104 of the 
television 102. Use is made of the so-called On Screen Display feature (OSD). Via the 
display device 104 the user is provided with graphical representations 218 of the data- 
elements; 

- switching means 204 for switching from a first one of the services to a 
second one of the services. Switching might mean that new application data is downloaded to 
be run. But it is also possible that one and the same application is handling multiple services. 

- a filter 206 for selecting data-elements of the first one of the services on basis 
of the user selection made by the user. Note that multiple data-elements related to the same 
information are sent. E.g. assume that the information is the current score of a live football 
match. As long as the score equals "0-1" data-elements are exchanged, e.g. every second, 
containing this information. However, if a goal has been made the situation is changed and 
from that moment on data-elements will be exchanged reflecting the new situation, e.g. data- 
elements representing the score with value "0-2". 

- rendering means 208 for calculating graphical representations of data- 
elements to be displayed on the display device 104, on basis of output of the filter 206; 

- an Ethernet connector 216 for exchange of information from the system 100 
back to e.g. the broadcast server 110; 

- a video processor 222 for processing the video stream. Eventually the 
graphical representations of data-elements are merged with the input images of the video 
stream resulting in a series of output images to be displayed on the display device 104. The 
rendering means 208 are arranged to merge these. The signal representing these output 
images is provided to the input connector 210 of the television 102. 
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- an audio processor 224 for processing the audio stream. The signal 
representing the processed audio stream is provided to the input connector 21 1 of the 
television 102. 

The working of the system 100 according to the invention will be explained by 
5 means of examples. It is assumed that the data-elements being exchanged from broadcast 
server 1 10 to the system 100 are conform a predefined information model. Table 1 comprises 
a part of such an information model. Each row of Table 1 belongs to a separate data type. The 
first column corresponds to a unique identification of each data type. The second column 
corresponds to the name of the data type. The third column corresponds to the type of the 
10 data type. In the fourth column a description of the data type is given and in the fifth column 
an example of the data type is given. 



Table 1: specification of data-elements: 



Identification 


Name 


Type 


Description 


Example 


0000 


Score 


Integer array 


Current score of sports game 


2,3 


0001 


HalfScore 


Integer array 


Score of sports game after half 
playing time 


0,0 


0002 


FinalScore 


Integer array 


Score of sports game after full 
playing time 


3,4 


0003 


Goaltimes 


Integer array 


Moments of time of the goals 


12,34,56 



15 Suppose that a user has selected a first service of the transport stream. This 

service corresponds with a football match between teams A and B. The user is interested to 
be informed about the current score of the match. Via the remote control 220 of the system 
the user provides a command to show which type of score information is available in the first 
service. The result of this command is that the application running on the system 100 creates 

20 a graphical overlay, which is mixed with the input images of the video stream, by means of 
the rendering means 208. The final output images are displayed on the display device 104 of 
the television. These output images comprises the following text: 
"What do you want to be shown?" 

- "Current score" 

25 - "Score after half playing time" 

- "When were the goals made" 
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The user indicates that only the current score should be displayed. As a result, from now on 
the filter 204 will fetch all data-elements of the data stream with the right type, i.e. with 
identification 0000 and with name "Score" (See Table 1). Data-elements which do not have 
this type will be skipped by the filter. A graphical representation of the current score will be 

5 displayed on the display device 1 04. Note that the values of the series of incoming data- 
elements might be mutually different, e.g. "0-0", "0-1", "1-1", etcetera. 

After a while the user switches to another service, e.g. corresponding to a 
movie. In the elementary streams corresponding to this service there are no data-elements 
with the type corresponding to "Score". Hence there will be nothing displayed about football 

10 scores. 

Then the user zaps further to a third service which corresponds to a football 
match between team C and team D. In the elementary streams corresponding to this third 
service there are data-elements with the type corresponding to "Score". The filter 204 will 
fetch these data-elements and a graphical representation of the current score of the match 

15 between team C and D will be displayed on the display device 104. 

Up till now the data-elements were considered as independent information 
entities. However in most cases data-elements are structured, e.g. in modules or objects. A 
common approach of modeling is based on objects being specified by their data-elements and 
the parents and child they have. In such a way a so-called object tree can be defined. For 

20 instance a tree with as root "sports". The children of the root-object are "tennis" and 

"football". The children of the "football"-object are "World championship", "European 
championship" and "Dutch championship". The children of the "Dutch championship"-object 
are "schedule", "team" and "results". The "team"-object comprises "player"-objects and 
"coach"-object. In Table 2 some data-elements of the "player"-object, having a "football"- 

25 object as ancestor, are specified. 



Table 2: specification of data-elements of "player" object for "football": 



Identification 


Name 


Type 


Description 


Example 


1000 


FirstName 


String 


Family name 


Jansen 


1001 


NickName 


String 


Nick name 


Speedy 


1002 


Age 


Integer 


Age 


25 


1003 


Interlands 


Integer 


Number of international games 
played 


17 
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For tennis a similar object definition is made, but which is slightly different. 

See table 3. 



Table 3: specification of data-elements of "player" object for "tennis": 



Identification 


Name 


Type 


Description 


Example 


2000 


FirstName 


String 


Family name 


Jansen 


2001 


NickName 


String 


Nick name 


Speedy 


2002 


Age 


Integer 


Age 


25 ; 


2003 


Tourname 
nts 


Array of 
Strings 


International tournaments won 


Wimble 
don 



5 

Suppose that the user, watching the football match between team A and B had 
indicated to display the information of the players. Then the user switches to a service 
corresponding to a tennis game. The result will be that the information comprised by the 
"player"-objects of tennis will be displayed. Hence, the number of international games played 

10 will not be shown but instead the international tournaments won will be listed. This can be 
realized in several ways. A first approach is based on filtering on a data-element related to a 
"player"-object. Another approach is based on a mapping table in which is specified that 
data-elements with identification 1003 (Interlands) must be mapped to 2003 (Tournaments). 
This mapping can be realized by a so-called converter. 

15 Not only for sports but for every type of service an information model can be 

made. Even by switching from a sport service to a movie service, the filter defined while 
watching the first service, can be reused. By means of example the "actors-object of a movie 
is given in Table 4. So switching from football to a movie might mean that a data-sheet of an 
actor currently visible is provided too. This is because the converter maps a "players-object 

20 to an "actor"-object. 
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Table 4: specification of data-elements of "actor" object for "movie" 



Identification 


Name 


Type 


Description 


Example 


3000 


FirstName 


String 


Family name 


Nickelson 


3001 


NickName 


String 


Nick name 


Speedy 


3002 


Age 


Integer 


Age 


25 


3003 


Movies 


Array of 
Strings 


Played in these movies 


Shining 



It should be noted that the above-mentioned embodiments illustrate rather than 
5 limit the invention and that those skilled in the art will be able to design alternative 

embodiments without departing from the scope of the appended claims. In the claims, any 
reference signs placed between parentheses shall not be constructed as limiting the claim. 
The word 'comprising' does not exclude the presence of elements or steps not listed in a 
claim. The word "a" or "an" preceding an element does not exclude the presence of a 
1 0 plurality of such elements. The invention can be implemented by means of hardware 

comprising several distinct elements and by means of a suitable programmed computer. In 
the unit claims enumerating several means, several of these means can be embodied by one 
and the same item of hardware. 



